🕷️️ Job Radar • SCRAPING

freelancer.com 2026-04-29 🟢

🔹 Web Spider for Law Library Contacts
👤 Client: 🇺🇸 New York, United States Member since 2005-02-08
💰 Price: $127 Average bid
🚩 Problem: Automate collection of contact information for law librarians across USA and Canada.
📦 Existing: Not specified

Specifications:

[Target] Define target websites hosting law librarian directories or contact pages in USA and Canada.
[Method] Develop a web spider using Python with libraries like Scrapy to scrape data from identified sites.
[UI/UX] Not applicable for backend task, but ensure user-friendly interface for data export.
[Stack] Python, Scrapy, BeautifulSoup, Selenium (if dynamic content), PostgreSQL for storage.
[Security] Implement rate limiting and IP rotation to avoid detection. Ensure compliance with website terms of service.
[Format] Export data in JSON or CSV format.

Workflow:

Identify and document target websites.
Set up web spider using Scrapy framework.
Implement scraping logic for contact information.
Test spider on a small dataset to ensure accuracy.
Deploy spider with rate limiting and IP rotation settings.
Scrape data in batches of 1,000 records at a time.
Export collected data into JSON or CSV format.